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foreword 

This  report  is  one  of  several  being  generated  during  a two 
year  investigation  into  a variety  of  questions  concerning 
major  aircraft  accidents.  The  Naval  Safety  Center,  Norfolk, 
is  the  sponsor  and  data  for  the  study  has  been  provided  by 
them.  More  recently,  since  January  1976,  data  has  also  been 
provided  by  the  Maintenance  Support  Office  Department, 
Mechanicsburg,  Pennsylvania. 


NOTE:  All  accident  rates  in  this  paper  are  in  terms  of  the 

number  of  accidents  per  10,000  flight  hours. 
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INTRODUCTION: 


Previous  work  by  this  author  and  two  of  his  military 
officer  theses  students  was  reported  by  Maxwell  and  Stucki 
(1975) . That  report  described  an  effort  in  which  multiple 
regression  techniques  were  used  to  determine  what  types  of 
variables  appear  to  be  able  to  account  for  the  variability 
observed  in  monthly  aircraft  accident  rates  for  all  Navy/ 
Marine . 

This  report  is  also  concerned  with  variability  in 
monthly  accident  rates  but  examines  a variety  of  questions 
with  regard  to  the  existence  of  a consistent  monthly 
influence  on  the  major  accident  rate,  i.e.  does  a specific 
month  or  two  consistently  have  high  accident  rates  from  year 
to  year? 

FISCAL  YEAR  ANALYSIS: 

Examination  of  the  monthly  accident  rates  by  month  by 
year  for  all  Navy/Marine  provides  the  graphs  shown  in  Figures 
1,  2 and  3 for  FY69-FY74.  These  figures  show  the  mean  and 
2a  limits  and  are  similar  to  control  charts  used  in  indus- 
trial quality  control  for  purposes  of  checking  when  an 
on-going  time  process  is  out  of  control.  Only  1 month  falls 
beyond  the  2a  boundaries  and  that  is  January  of  FY69.  How- 
ever, examining  the  following  years,  one  sees  January  is 
secord  to  lowest  in  FY70,  and  again  second  lowest  in  FY71, 
etc.  In  other  words,  January  does  not  remain  consistently 
high  from  year  to  year.  Another  example  might  be  June,  where 
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over  the  6 years,  it  is  with  respect  to  the  mean:  below, 

above,  above,  above,  below,  below.  Again  no  consistent  trend 
appears  nor  does  it  appear  with  any  month.  There  does  not 
appear  to  be  any  month  which  is  consistently  high  to  support 
any  belief  of  a consistent  monthly  effect.  Further  evidence 
is  obtained  by  looking  at  the  number  of  data  points  located 
within  la  of  the  means  shown  in  the  6 yearly  graphs. 

Although  the  la  limits  are  not  shown  on  the  graphs,  one  will 
find  that  50  of  the  72  monthly  data  points  fall  within  la  . 
This  is  69%  and  very  close  to  the  theoretical  68%  one  would 
expect  to  fall  within  la  limits  per  conventional  probability 
and  statistics.  As  further  evidence,  a test  for  uniformity  of 
the  yearly  accident  rate  distributions  was  run  using  a test 
developed  by  Kuiper  (1960)  which  is  an  adaptation  of  the 
p<  pular  Kolmogorov-Smirnov  test  and  is  more  applicable  here 
because  Kuiper' s test  statistic,  VN,  doesn't  depend  on  which 
month  one  uses  as  a starting  point  to  test  for  uniformity 
during  the  fiscal  year.  Using  Kuiper 's  test  on  each  of  the 
6 years,  the  hypothesis  of  a uniform  distribution  of  accident 
rates  throughout  the  year  would  not  be  rejected  (p>.10).  The 
accident  rates  over  each  year  are  uniform  and  there  appears  to 
be  no  consistent  monthly  effect  for  any  month  year  after  year. 

As  an  informal  exercise,  this  author  also  interviewed 
approximately  30  Navy  pilots  who  expressed  the  unanimous 
opinion  that  when  in  a squadron,  they  were  often  made  aware 
that  the  previous  year  had  a hight  accident  rate  for  the  next 
month  coming  up,  and  that  they  should  be  more  cautious  next 
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month.  Sure  enough#  they  reported  the  rate  would  go  down  but 
then  they  would  "relax"  later  on  and  a month  that  was  low  the 
year  before  would  have  a high  accident  rate  when  the  squadron 
"relaxed"  after  the  so  called  bad  month  had  passed.  This 
phenomena  seems  to  act  to  push  the  rate  down  in  one  month  but 
then  the  rate  will  rise  up  in  another  to  support  the  uniform 
random  distributions  already  illustrated  statistically. 

Previous  work  by  Robino  (1972)  made  a point  of  the  fact 
that  for  FY67-FY72,  the  month  of  March  had  the  highest  average 
accident  rate  for  the  6 years  in  AIRLANT.  An  ensuing  discussion 
then  tried  to  determine  reasons  why  March  was  the  worst  month 
for  the  6 years.  That  report  was  one  of  the  reasons  suggested 
by  the  Naval  Safety  Center  for  this  writer  to  pursue  the  current 
research.  This  writer  observed  that  Robino 's  argument  was 
based  purely  on  the  fact  that  March  had  the  highest  mathematical 
average  in  AIRLANT  over  6 years.  Using  Kuiper's  test  for  uni- 
formity on  Robino 's  data,  this  writer  finds  that  the  AIRLANT 
rates  for  FY67-FY72  are  statistically  uniform  (p>.10)  and  no 
strong  case  can  be  made  for  a March  phenomena.  Further,  this 
writer  assumed  that  FY67-FY72  was  of  no  particular  importance 
and  thus  looked  at  FY70-FY75,  i.e.  a six  year  period  also  but 
offset  3 years  later.  Looking  at  the  pure  mathematical  monthly 
averages  for  the  latter  6 year  period,  one  finds  July  is  now 
the  worst  month  followed  by  June.  If  Robino' s study  had  been 
done  3 years  later,  March  wouldn't  have  been  of  interest  but 
July  would  have  been.  The  above  exercise  is  not  meant  to 
degrade  Robino' s work  as  he  did  mention  a statistical  analysis 
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needed  to  be  done.  The  purpose  of  the  above  was  to  illustrate 
to  safety  researchers  that  simply  looking  at  accident  rates 
and  choosing  the  highest  one  to  concentrate  on  can  be  mis- 
leading. Any  set  of  averages  on  monthly  data  will  come  up 
with  one  month  as  the  highest  but  the  question  needs  to  be 
answered  as  to  whether  a uniform  distribution  exists  among 
the  averages.  If  not,  then  one  will  find  one  or  more  averages 
which  are  extremely  high  or  low  and  one  can  then  pursue  this 
month  with  much  more  confidence  that  the  month  in  question  is 
indeed  higher  (lower)  than  one  might  expect  beyond  elements 
of  random  variability. 


COMMAND  ANALYSIS: 

A similar  investigation  was  conducted  by  major  commands 
looking  for  consistent  cycles  and/or  months  which  appeared  to 
have  higher  than  statistically  reasonable  accident  rates.  The 
following  major  commands  were  considered: 

NAVAIRLANT 

MARLANT 

NAVAIRPAC 

MARPAC 

CNATRA 

Naval  Reserves 
MARTC 

RDTE  + NASC 

Data  was  available  for  FY70-FY75  for  all  commands  and  a six 
year  average  was  calculated  for  each  month  for  each  command. 


Each  command  was  tested  for  uniformity  of  the  distribution  of 
its  accident  rates  over  the  months  of  the  year.  In  each 
command,  the  hypothesis  of  a uniform  distribution  of  accident 
rates  by  months  over  the  year  was  accepted  (p>.10) . Mo 
evidence  of  non-uniformity  was  demonstrated  statistically  and 
further  observation  of  the  graphed  data  revealed  no  consistent 
trends.  (The  command  data  is  presented  numerically  in  Appendix 
A.) 


AIRCRAFT  ANALYSIS: 

After  examining  the  data  by  year  and  by  command,  indivi- 
dual types  of  aircraft  were  examined.  From  56  aircraft  of 
interest  initially,  only  7 had  enough  accident  data  and 
flight  hours  to  permit  adequate  statistical  examination.  The 
individual  aircraft  examined  were  A3,A4,A5,A6,A7,  F4  and  F-8. 
All  helicopters  were  combined  to  provide  an  eighth  group  of 
aircraft.  Data  for  these  aircraft  were  available  for  FY69- 
FY74.  Again,  a test  for  uniformity  of  the  distribution  of 
accident  rates  by  months  over  the  six  year  averages  for  each 
aircraft  showed  all  distributions  were  uniform.  The  hypothesis 
of  uniform  accident  rate  distributions  was  accepted  (p>.10) 
for  each  aircraft  including  helicopters  combined.  The  uniform 
hypothesis  would  have  been  rejected  if  one  month  (or  more)  had 
consistently  stood  out  higher  than  the  other  months.  (The  data 
for  aircraft  is  provided  in  Appendix  B) . No  consistent  trends 
were  evident  in  the  data,  as  might  be  expected  from  the  uni- 


form distributions. 


Another  avenue  of  investigation  was  to  examine  the 


correlations  of  accident  rates  between  years  over  the 
12  months.  If  there  was  a consistent  trend  for  say,  six 
months  to  be  high  always  and  the  other  six  to  be  low,  then 
from  year  to  year  the  correlation  between  the  monthly 
averages  of  the  two  years  should  be  high.  Tables  I,  II  and 
III  show  these  parametric  correlations  between  years  by 
command.  Based  on  the  data  set  size,  a correlation  of  .58 
or  higher  was  needed  to  show  a significant  relationship 
between  the  monthly  rates  of  two  given  years  at  the  .05 
level.  Any  correlation  less  than  .58  would  be  considered  due 
to  random  chance.  As  can  be  seen  in  the  tables,  only  3 sig- 
nificant correlations  were  found  and  these  were  each  in 
different  commands  and  between  different  years.  Again,  no 
consistency  of  correlation  trends  was  found  between  years  or 
commands,  thus  reinforcing  previous  results  that,  although 
accident  rates  do  move  up  and  down,  they  appear  to  do  so  in  a 
random  manner  resulting  in  uniform  distributions  of  the  acci- 
dent rates. 

CORRELATIONS  OF  FLIGHT  HOURS  VS.  ACCIDENT  RATES  AND  NUMBER 
OF  ACCIDENTS: 

The  possibility  that  the  number  of  accidents  tends  to 
go  up  and  down  with  the  amount  of  flight  hours  was  investigated 
next.  Since  the  correlation  between  number  of  accidents  and 
flight  hours,  and  the  correlation  between  accident  rate  and 
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flight  hours  would  yield  different  results , both  correlations 
were  run  under  both  a parametric  (Pearson  Product-Moment 
Correlation)  and  nonparametric  (Spearman  Rank-Order  Correla- 
tion) fashion.  The  nonparametric  approach  was  needed  since 
the  number  of  accidents  ranges  from  0 to  15  or  so  in  an 
integer  fashion.  Thus,  nonparametric  correlations  were  cal- 
culated first  and  were  expected  to  produce  the  best  results 
of  the  two  methods. 

The  rank  order  nonparametric  correlations  between  the 
number  of  accidents  and  the  accident  rate  with  the  number  of 
flight  hours  over  twelve  months  of  the  year  is  shown  in  Table 
IV.  Observation  of  the  values  in  this  table  show  only  5 

significant  correlations  out  of  98  shown hardly  enough  to 

show  any  significant  trend.  For  the  Table  IV  values,  the 
nonparametric  correlation  needed  to  exceed  .50  before  the 
correlation  would  be  significant  at  a » .05. 

These  results  were  not  encouraging  but  parametric  cor- 
relations were  run  on  the  same  data  anyway  and  are  shown  in 
Table  V where  a .58  parametric  correlation  was  needed  to  be 
significant  at  o ■ .05.  Surprisingly,  more  significant  cor- 
relations can  be  observed  in  Table  V and  one  should  specifi- 
cally note  the  correlation  between  number  of  accidents  and 
hours  flown  for  MARTC.  In  4 of  the  6 years,  MARTC  shows  a 
significant  relationship  between  number  of  accidents  and 
flight  hours.  This  provided  some  evidence  that  two-thirds  of 
the  time,  the  number  of  accidents  for  MARTC  appears  to  inc: ease 
and  decrease  in  direct  proportion  to  the  number  of  flight  hours. 
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To  examine  this  relationship  further.  Figure  4 shows  the  plot 
of  number  of  accidents  versus  flight  hours  for  the  significant 
4 years  shown  for  MARTC  in  Table  V,  i.e.  FY70,FY73,FY74,FY75. 
Of  further  interest  is  the  fact  that  the  correlation  was 
strong  for  3 years  in  a row— *FY73,FY74,FY75  giving  evidence 
of  a strong  trend.  Looking  at  Figure  4,  one  sees  an 
interesting  relationship  if  an  imaginary  vertical  line  is 
drawn  at  6000  hours.  For  months  where  more  than  6000  hours 
are  flown,  it  can  be  calculated  that  the  probability  of  one 
or  more  accidents  is  .87.  This  is  quite  a contrast  to  those 
months  where  less  than  6000  hours  were  flown  and  the  probabi- 
lity was  .33  of  an  accident  in  a given  month. 

Pursuing  this  further,  student  "t"  tests  were  run 
comparing  the  values  of  various  parameters  for  those  accidents 
in  months  with  more  than  6000  hours  versus  the  accidents  in 
those  months  with  less  than  6000  hours.  The  parameters  which 
were  examined  and  for  which  data  was  available  were:  pilot 

age,  pilot  DNA,  pilot  total  time  in  model  in  which  accident 
occurred,  pilot  hours  flown  during  last  90  days,  pilot  hours 
flown  during  last  90  nights,  number  of  aircraft  tours,  and 
aircraft  hours  since  last  major  inspection.  Only  one  of  these 
variables,  pilot  hours  flown  during  last  90  days,  showed  any 
significant  difference  (p<.05)  for  the  accidents  in  the 
months  with  less  than  6000  hours  versus  greater  than  6000 
hours.  For  the  months  where  less  than  6000  hours  were  flown, 
the  average  pilot  hours  in  the  last  90  days  was  20.2  per  pilot 
whereas  the  average  was  38.9  hours  in  the  last  90  days  for 
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accidents  which  occurred  in  months  with  more  than  6000  hours. 
Unfortunately,  data  is  not  available  to  compare  these  data 
with  those  of  pilots  who  didn't  have  accidents.  However,  one 
might  hypothesize  that  :*  fatigue  factor  may  enter  here  but  it 
is  difficult  to  know  when  the  hours  in  the  last  90  days  were 
flown.  If  they  all  occurred  in  the  last  30  of  the  90  days, 
one  might  suspect  fatigue  much  more.  It  is  this  author's 
understanding  that  hours  flown  in  the  last  30  days  has  begun 
to  be  collected  in  1976  so  could  prove  useful  in  the  future. 
For  greater  or  less  than  6000  hour  months,  the  distribution 
of  the  last  90  day  hours  is  uniform  in  both  cases  with  the 
"less  than  6000  flight  hour"  months  embedded  in  the  left  tail 
of  the  "greater  than  6000  flight  hour"  months.  In  the  months 
with  lass  than  6000  flight  hours,  all  accidents  for  which 
data  was  available,  occurred  with  pilot  hours  in  the  last  90 
days  of  35  hours  or  less.  The  data  are  given  in  Appendix  C. 

Looking  at  the  flight  purpose  codes  for  the  MARTC 
accidents,  no  special  type  of  operations  appear  to  contribute 
more  to  accidents  as  97.4%  of  them  occurred  in  daylight  visual 
conditions  and  82.1%  occurred  in  unit  training.  The  others 
were  randomly  spread  over  a variety  of  reasons. 


SUMMARY; 

No  consistent  trends  or  monthly  cyclical  phenomena  have 
appeared  in  this  investigation  so  far.  Many  items  appear  to 
exhibit  such  trends  but  upon  further  analysis,  none  pass  any 
statistical  tests  to  verify  their  existence  beyond  reasonable 


elements  of  chance. 

The  6000  hour  break  in  total  monthly  flight  hours  for 
MARTC  and  the  resulting  probabilities  of  accidents  below  and 
above  that  mark  are  quite  significant.  However,  the  impli- 
cations of  this  need  to  be  investigated  further  with  more 
data  as  discussed  with  LCDR  R.  Mister  during  his  visit  tc  the 
author  in  May  1976. 

In  addition  to  the  above,  the  author  has  three  more 
military  officer  students  currently  working  on  the  develop- 
ment of  regression  equations  to  predict  monthly  accident 
rates.  This  is  a completely  different  problem  from  the 
monthly  or  cyclical  phenomena  since  regression  equations 
would  be  very  useful  in  predicting  monthly  accident  rates, 
regardless  of  whether  any  monthly  or  cyclical  phenomena 
existed. 
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APPENDIX  C 


DATA  ATAIUBIE  FOR  MARTC  COMAO  SHOVING  PILOT 
HOURS  FLOWN  IN  LAST  90  DAIS  FOR  THOSE  ACCIDENTS 
WHICH  OCCUHREB  IN  MONTHS  WITH  IESS  THAN  6000 
FLKHT  HOURS  VS  MONTHS  WITH  MORE  THAN  6000 
FLIGHT  HOURS 


PILOT  HOURS  71 


• i 


LAST  90  DAIS 


less  than  6000  hours 
in  ths  month 


More  than  6000  hours 
In  the  month 


5 

45 

J 

5 

25 

35 

35 

25 

55 

26 

15 

31 

15 

29 

15 

i 

5 

25 

! 

21 

45 

j, 

45 

t 

j « 

66 

50 

1 

22 

l 

17 

f 

i 

88 

i 

t 

72 

I 

33 

1 

32 
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